A finite difference method for piecewise deterministic Markov processes
نویسنده
چکیده
An extension of non-deterministic processes driven by the random telegraph signal is introduced in the framework of piecewise deterministic Markov processes [9], including a broader category of random systems. The corresponding Liouville-Master Equation is established and the upwind method is applied to numerical calculation of the distribution function. The convergence of the numerical solution is proved under an appropriate Courant-Friedrichs-Lewy condition. The same condition preserve the non-decreasing property of the calculated distribution function. Some numerical tests are presented.
منابع مشابه
Moment Closure and Finite-Time Blowup for Piecewise Deterministic Markov Processes
We present a variety of results analyzing the behavior of a class of stochastic processes — referred to as Piecewise Deterministic Markov Processes (PDMPs) — on the infinite time interval, and determine general conditions on when the moments of such processes will, or will not, be wellbehaved. We also characterize the types of finite-time blowups that are possible for these processes, and obtai...
متن کاملA Finite Difference Method for Piecewise Deterministic Processes with Memory
Abstract. In this paper the numerical approximation of solutions of Liouville-Master Equations for time-dependent distribution functions of Piecewise Deterministic Processes with memory is considered. These equations are linear hyperbolic PDEs with non-constant coefficients, and boundary conditions that depend on integrals over the interior of the integration domain. We construct a finite diffe...
متن کاملOptimal Control of Piecewise Deterministic Markov Processes with Finite Time Horizon
In this paper we study controlled Piecewise Deterministic Markov Processes with finite time horizon and unbounded rewards. Using an embedding procedure we reduce these problems to discrete-time Markov Decision Processes. Under some continuity and compactness conditions we establish the existence of an optimal policy and show that the value function is the unique solution of the Bellman equation...
متن کاملPiecewise-deterministic Markov Processes for Sequential Monte Carlo and MCMC∗
This talk will introduce piecewise-deterministic Markov processes, and show how they can be used to develop novel, continuous-time, variants of MCMC or SMC. A particular motivation for this work is to develop Monte Carlo methods that can sample from a posterior and that scale well to large-data.
متن کاملOptimal control of infinite-dimensional piecewise deterministic Markov processes and application to the control of neuronal dynamics via Optogenetics
In this paper we define an infinite-dimensional controlled piecewise deterministic Markov process (PDMP) and we study an optimal control problem with finite time horizon and unbounded cost. This process is a coupling between a continuous time Markov Chain and a set of semilinear parabolic partial differential equations, both processes depending on the control. We apply dynamic programming to th...
متن کامل